Portable explosive or drug detection system

ABSTRACT

Systems and methods are disclosed to automatically detect the presence of a substance on a test swipe by capturing a background image of the test swipe; applying one or more test chemicals to a test swipe; adjusting the temperature of the test swipe to a predetermined temperature range; capturing an in-situ image of the test swipe after the application of chemical at the predetermined temperature range; subtracting the background image from the in-situ image; generating a difference value from the two images; and searching a known database to identify the substance.

BACKGROUND

This invention relates to systems for the detection of explosives andother controlled substances such as drugs or narcotics as well as otherchemicals used in clandestine activities.

Recent terror attacks have changed the dynamics of the explosivedetection systems across the globe. Terrorists, acting singly or inconcert, instill immense fear and apprehension in civilians andgovernments alike with their technical knowledge about explosives. Inparallel, the world has experienced an increase in the transportation ofcontraband substances such as drugs or narcotics.

With advances in explosives technology, such as the advent of theplastic explosives, which can be disguised as common items, it isbecoming increasingly difficult to detect these substances. The problemsthat must be overcome in the detection of these substances as well asothers, include low vapor pressure of the particular vapors escapingfrom the particular substance, the search time and the throughput of thevarious systems, the low concentration of vapor or particulate emissionsfrom the particular substance, isolation of the particular substancewith a high degree of reliability, and maintaining the integrity of thesystems environment.

Various techniques for detecting substances such as explosives and drugsor narcotics have been developed, ranging from explosives/drug sniffingdogs to highly sophisticated vapor detection devices. Machine detectionof the aforementioned substances can be accomplished through non-vapordetection or vapor detection. Non-vapor detection methods include x-raydetection, gamma-ray detection, neutron activation detection and nuclearmagnetic resonance detection. These methods of detection are moreapplicable to the detection of the various substances when thesubstances are concealed and are carried or associated with non-livingitems such as baggage as these techniques might pose a threat to livingitems. Vapor detection methods include electron capture detection, gaschromatography detection, mass spectroscopy detection, plasmachromatography detection, bio-sensor detection and laser photo-acousticdetection. These methods of detection are more applicable to thedetection of substances that are concealed and associated with livingspecimens.

Conventional systems tend to be large and immobile. Further, currentsystems can require users to manually apply toxic chemicals as testingagents. As a result, conventional systems are not mobile and hard touse. Hence, their adoption for field use has been limited.

SUMMARY

In one aspect, systems and methods are disclosed to automatically detectthe presence of a substance on a test swipe by capturing a backgroundimage of the test swipe; applying one or more test chemicals to a testswipe; adjusting the temperature of the test swipe to a predeterminedtemperature range; capturing an in-situ image of the test swipe afterthe application of chemical at the predetermined temperature range;subtracting the background image from the in-situ image; generating adifference value from the two images; and searching a known database toidentify the substance.

In another aspect, a portable handheld chemical analytical apparatus toanalyze a test swipe for chemicals such as household, drug, andclandestine, and explosive chemicals is disclosed. The apparatusincludes a heater to warm the test swipe to a predetermined temperature;a clamp to secure the test swipe to the heater; one or more pumps todispense one or more chemicals onto the test swipe; a fan to circulatechemical vapors rising from the test swipe; and a camera to capture animage of the test swipe for analysis.

In yet another aspect, a method to analyze a swiped sample to identify achemical composition, includes automatically pumping a series ofchemical solution agents into the swiped sample; heating the swipedsample to one or more predetermined temperatures, held for a specifictime increment at that temperature to accelerate and optimize thechemical reactions and resulting color; capturing one or more images ofthe chemical reaction; sending the images to a display screen foroperator observation; and analyzing the images to identify the chemicalcomposition based on a chemical reaction database.

Advantages of the system may include one or more of the following. Thesystem tests the presence of chemical materials or compounds using anumber of factors or parameters singly, sequentially, or in concert. Thefactors can include heat, volume, time, temperature, and vapor control,among others and sequences these factors over time. The sequences can bein unique intervals. As a result, the system is highly reliable andreduces “false positives” due to its multi-factor, multi-step diagnosticoperations.

The system significantly enhances the possibility of accurately andquickly screening personnel, equipment, and materials at securitycheckpoints, military operations, law enforcement, or other screeningscenarios, and for detecting trace levels of explosive materials. Thesystem allows users to precisely, sequentially, and quickly detectdifferent explosive or other chemical agents under adverse climateconditions such as high humidity and pressure changes.

The system operates in a real-time fashion. It automatically dispenses aprecise volume of chemical solutions over time when requested. Thesystem optionally allows users to manually control the sequence of thepumping process. The system provides users with pump controls fordispensing chemical solutions. Through the built-in heater, the systemautomatically heats up the swiped sample to predetermined temperaturesover specific time parameters using an automatic ramped heating feedbackcontrol. The system automatically and continually performs self-checkand monitors fluid levels, temperature and time. The systemautomatically chronologically stores data and arranges according topositive results versus negative results. The system automatically tellsthe operator to remove the analyzed swipe. The system delivers a uniquesequence of precise chemical volumes under time, heat, and vaporparameters. The system has detachable and expendable chemical(s) incartridge form for ease of replacement. The system uses ahigh-resolution digital camera for data collection and analysis.

By use of a wired or wireless transceiver, detected information can beeasily transmitted or received anywhere in the world. By replacingdisposable swipes/pads/swabs and disposable chemical test reservoirs,the system can detect a wide range of explosives, clandestine material,drugs, and household products used to manufacture explosives, a range ofcontrolled chemical agents, drugs, and narcotics etc. By allowing theuser to swap test materials and running a computerized diagnostics, theuser can easily and effectively change the system to meet what isconsidered to be the threat at that time. By having all components underprogram control and by arranging for a known input to the system such asa controlled injection of target material, the system can performself-calibration and self-diagnostic.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other objects, features, and advantages of the presentinvention will be better understood from the following detaileddescriptions taken in conjunction with the accompanying drawings, all ofwhich are given by way of illustration only, and are not limitative ofthe present invention, in which:

FIGS. 1A1 and 1A2 show an exemplary image processing flowchart to detectchemical substances using a camera.

FIG. 1B1 shows an exemplary diagram illustrating hue quantization.

FIG. 1B2 shows an exemplary color processing flowchart.

FIG. 1C shows an exemplary process to generate a master database ofchemical substances to be compared against.

FIG. 2 shows an exemplary portable chemical detection device.

FIGS. 3A and 3B show in more details major components of the device.

FIG. 4 shows in more details a swipe receiving port.

FIG. 5A shows an exemplary perspective view of a camera in a testchamber.

FIG. 5B shows an exemplary perspective view of tubing and cameraactuator in the test chamber.

FIG. 6 shows an exemplary block diagram of processing electronics forthe system of FIG. 1.

FIG. 7 shows an exemplary operational flow chart executed by the systemof FIG. 1.

FIG. 8 shows an exemplary image analysis process executed by theprocessor of FIG. 6 to detect chemical agents automatically.

DESCRIPTION

The following detailed description of the invention is provided to aidthose skilled in the art in practicing the present invention. Even so,the following detailed description of the invention should not beconstrued to unduly limit the present invention, as modifications andvariations in the embodiments herein discussed may be made by those ofordinary skill in the art without departing from the spirit or scope ofthe present inventive discovery.

FIGS. 1A1 and 1A2 (collectively FIG. 1A) shows an exemplary process thatcan capture and process an image to detect a chemical substance. In oneembodiment, the process of FIG. 1A runs on a handheld device that offersaccurate, reliable analysis and portability while keeping powerconsumption to a minimal requirement. As discussed in more detailsbelow, the handheld device has a processor that captures images of atest swipe and executes image processing code on the image and comparesdata from the test swipe against a known substance database. If a matchoccurs, the system notifies the user.

Viewing FIGS. 1A1 and 1A2 together, a process for performing imageprocessing on a test swipe is shown. The process configures a camera(502). The process checks if the camera has been successfully configured(504). If not, the process generates a hardware warning (542) and exits.Alternatively, if successful, the process configures a parallel port(PPI) and the direct memory access (DMA) ports in 506. Next, the processchecks to see if the ports are properly configured (508). If not, theprocess generates a hardware warning (542) and exits. Alternatively, ifthe operation in 508 is successful, the process opens an image database(510) and checks for success (512). If there is no database, the processcreates a new database (514).

From 512 or 514, the process captures a background pattern with theswipe (516). Next, the process waits for a heater to change thetemperature of the swipe to a predetermined temperature range (518). Theprocess then captures a sample pattern of the swipe after chemicals areapplied and after it is at the predetermined temperature (520). Thesample pattern is subtracted from the background pattern (522) and ahistogram is computed (524).

In (524), the histogram can be a plot of the number of pixels for eachpossible grayscale value. The histogram is a graph that shows thedistribution of intensities in an image. The horizontal axis representsthe full range of tonal values, the vertical axis indicates the numberof pixels for each intensity value. In one embodiment that compares twoimages on a specific basis, such as texture, the process can normalizetheir histograms to a “standard” histogram. Histogram equalization canbe used through the application of a function b=(a) into a histogramthat is constant for all brightness values. This would correspond to abrightness distribution where all values are equally probable.

Next, the process matches the image against a known substance database.In this process, the process searches for an item in the database (526).The process picks the first database element and computes a differencemeasure such as the Euclidean distance between the database element andthe histogram (528). The difference is checked to see if it is within apredetermined threshold (530). The user is notified (532) if there is amatch and the process moves to operation (536) to see if the testingprocedure is completed. If there is no match, the process checks to seeif the sample data has been compared against all known database elements(534). If not, the pointer is incremented to the next database elementand the process loops back to (536) to compare the sample data againstthe next database element. Alternatively, if the sample data does notmatch any elements in the database, a message is displayed to indicateno matching pattern. From operation (536), if additional testingoperations remain, the process loops back to apply a different chemicaland perform another test. If the testing procedure is completed in(536), the process exits.

The process of FIGS. 1B1-1B2 detects the explosive materials using thecolors resulting from chemical reactions. In order to do this, thecamera captures raw RGB data and processes the data using a colorrecognition algorithm shown in FIG. 1B2.

FIG. 1B1 shows an exemplary diagram illustrating hue quantization whileFIG. 1C shows an exemplary color processing flowchart. The cameraoperates in the RGB color space. However, since the R, G, and Bcomponents are equally important in distinguishing a color, the systemquantizes them uniformly to create the RGB histogram. This may result ina large amount of data to be processed. On the other hand, the HSV colorspace is a non linear one. The system applies a non uniform quantizationto each dimension of this space, as illustrated in FIG. 1B1 to arrive atthe HSV color space in one embodiment.

In one embodiment, the RGB to HSV conversion is defined by the followingequations. In these equations, MAX and MIN represent the maximum andminimum values of each RGB triplet, respectively. H, S, and V vary from0 to 1, where 1 represents the greatest saturation and value.

$H = \left\{ {{\begin{matrix}{{\left( \frac{G - B}{{MAX} - {MIN}} \right)/6},{{{if}\mspace{14mu} R} = {MAX}}} \\{{\left( {2 + \frac{B - R}{{MAX} - {MIN}}} \right)/6},{{{if}\mspace{14mu} G} = {MAX}}} \\{{\left( {4 + \frac{R - G}{{MAX} - {MIN}}} \right)/6},{{{if}\mspace{14mu} B} = {MAX}}}\end{matrix}S} = {{\frac{{MAX} - {MIN}}{MAX}V} = {MAX}}} \right.$

After RGB to HSV conversion, the system quantizes hue, saturation andvalue to given numbers of bins. Since hue and saturation play the mostimportant role in identifying a color, a non-uniform quantization isused to reduce the computational load. For example, hue is quantizedusing N_(H)=24 bins, saturation using N_(S)=4 bins, while value usingN_(V)=3 bins. Using the quantized values of hue, saturation and value,the histogram for each component is constructed.

Next, the histogram Euclidean distance is determined. Let h and grespectively represent the reference HSV histogram and the histogram ofthe test image. Each histogram is organized as an array of integerelements. Each element contains the probability that the HSV values fallto some bin. Then, Euclidean distance is computed as:

$d = {\sum\limits_{i = 1}^{N}{h_{i}g_{i}}}$

Where N is the length of each array.N is determined as follows:

N=N_(H) if we utilize only Hue component to detect the color

N=N_(H)N_(S) if we utilize Hue and Saturation components to detect thecolor

N=N_(H)N_(S)N_(V) if we utilize all three components to detect the color

N_(H), N_(S), N_(V) are respectively the quantization bins of Hue,Saturation and Value.

FIG. 1B2 shows an exemplary process to perform color processing. In FIG.1B2, the process converts image data from RGB space to HSV space (550).Next, the HSV data is quantized as described above (552). The processcreates an HSV histogram (554). Next, a threshold distance d_(th) and aminimum distance d_(min) are set (556) and the databases are opened(558). The process reads one histogram g from the database (560). Theprocess computes a Euclidean distance d (562). The process then checksto see if the minimum distance is met (562) and if so the currentsubstance (as indicated by the histogram) is the best match so far. Theprocess saves the name of the material as a candidate (564) and updatesthe minimum distance (568). From (562), if the current histogram is aworse match than the best so far, the process jumps to (570) to examinethe next histogram in the database. The process then reads the nexthistogram for comparison (570) and iterates the testing of eachhistogram through the end of the database (580). In this manner, theprocess checks for the best match.

Once the entire database has been checked, if the distance is less thanthe threshold distance in 582 indicating that the minimum matchrequirement has been met, the process displays the substance name (584).Alternatively, if the histogram of the material being tested differs somuch from any of the histograms stored in the database, the processdisplays a “No Match” message (586) and exits.

FIG. 1C shows an exemplary process to generate a database of chemicalsubstances that is compared against by the process of FIG. 1A. Theprocess of FIG. 1C generates a known test element database. The testdatabase contains a unique signature for each chemical substance to betested against. For example, if the system is to check for the presenceof cocaine, a sample cocaine element is obtained, a test swipe isapplied against the cocaine element, and the test swipe is run throughthe image processing operations detailed in FIG. 1A The result is savedas an exemplary database storing signatures of chemical substancesoperating in conjunction with the system of FIG. 1A.

Turning now to FIG. 1C, a user selects a control test swipe and appliesthe swipe against a known predetermined substance (600). Next, the userprograms into the device a test sequence including temperature range andchemical(s) to be applied against the test substance (610). The systemof FIG. 2 then processes the test swipe in accordance with the testsequence, including a temperature range/sequence of temperature, and asequence of chemical(s) to be dispensed (620). Other variables in theprocessing sequence can be specified as well. In (630), the result ofthe imaging analysis, as well as the test sequence, is saved for thefuture. A test swipe applied to unknown substances will be processed inan identical manner and the result can then be compared to thecontrolled result generated in FIG. 1A.

One example is a sequence involving chemistry, time, temperature ramprates and hold times to optimize each of the results for explosives,drugs, or other threat chemicals within a chemical reaction sequence.The system always adjusts the start temperature (404) (FIG. 8) prior torunning a particular sequence to a predetermined temperature value. Anexample of this may be 35° C. whereby the swipe (32) (FIG. 2) retaininga wet or dry sample is adequately held and in intimate contact with theelements of the swipe holder (34) (FIG. 4). Not mentioned in thissection are the specific parameter controls for fan speed, LED lighting,pumping increments, GUI, camera, speaker, or display.

The background image of the swipe at this temperature is taken so as tosubtract out any colors that may be present on the swipe prior toanalysis. A selected chemical reactant from one of the reservoirs isthen pumped onto the swipe in a non-drip fashion and in a volume of20-30 μL, most favorable being 25 μL. The system takes a second image ofthe chemically reacted sample on the swipe and immediately processesthis image from the subtracted background for color indicatingperoxides. The second image then becomes the new background imagewhether peroxides are present or not for the next analyte sought whichis hexamethylene triperoxide diamine HMTD.

Further reacting of the sample material on the swipe, the heater elementbegins rapidly heating only the sample area on the swipe withtemperature setting ramp rates of 10-20° C. per minute to 115° C., mostfavorable being 15° C. per minute. During the ramp, a third image istaken between 5-15 seconds, 12 seconds being most favorable, to analyzefor color indicating HMTD. The system takes a third image of thechemically reacted sample on the swipe and immediately processes thisimage from the second background for presence of HMTD. Once the heaterelement reaches 115° C., it then holds a for 20-40 seconds, 30 secondsbeing most favorable. The third image then becomes the new backgroundimage whether HMTD was present or not for the next analyte sought whichis triacetone triperoxide TATP.

During the hold time, a fourth image is taken of the chemically reactedsample on the swipe at 25 to 30 seconds, 28 seconds being mostfavorable, and immediately processes this image from the thirdbackground for presence of the color indicating TATP. The fourth imagethen becomes the new background image whether TATP was present or notfor the next analytes sought which are chlorates.

During the same hold time, a fifth image is taken of the chemicallyreacted sample on the swipe at 25 to 35 seconds, 30 seconds being mostfavorable, and immediately processes this image from the fourthbackground for presence of the color indicating chlorates. The fifthimage then becomes the new background image whether chlorates werepresent or not for the next analyte sought which is TNT.

The heater element begins rapidly heating only the sample area on theswipe with temperature setting ramp rates of 10-20° C. per minute to140° C., most favorable being 15° C. per minute. Simultaneously, asecond selected chemical reactant from one of the reservoirs is thenpumped onto the swipe in a non-drip fashion and in a volume of 20-30 μL,most favorable being 25 μL. Once the heater element reaches 140° C., itthen holds for 10-20 seconds, 10 seconds being most favorable. Duringthe second temperature ramp, a sixth image is taken between 5-15seconds, 8 seconds being most favorable, to analyze for color indicatingTNT. The sixth image then becomes the new background image whether TNTwas present or not for the next analytes sought which are all highexplosives.

The heater element begins rapidly heating only the sample area on theswipe with temperature setting ramp rates of 10-20° C. per minute to155° C., most favorable being 15° C. per minute. Simultaneously, a thirdselected chemical reactant from one of the reservoirs is then pumpedonto the swipe in a non-drip fashion and in a volume of 20-30 μL, mostfavorable being 25 μL. Once the heater element reaches 155° C., it thenholds for 10-20 seconds, 20 seconds being most favorable. During thethird temperature ramp, a seventh image is taken between 5-15 seconds, 5seconds being most favorable, to analyze for colors indicating all highexplosives. The seventh image then becomes the new background imagewhether high explosives were present or not for the next analytes soughtwhich are all nitrates.

The heater element continues to hold at 155° C. and from 10-20 seconds,an eighth image is taken between 10-20 seconds, 15 seconds being mostfavorable, to analyze for colors indicating all nitrates. The heaterelement immediately cools down for the next sample run.

Another example of a single test involving chemistry, time, temperaturesettings, and hold times to optimize results for a chemical reactioninvolves depositing one or more of the chemical reactants from theirrespective reservoirs onto the swipe in a non-drip fashion. This is toimpart a single spot test or multiple spot tests for a single drug ordrugs, a single explosive or explosives, or other threat chemicals atambient or preset temperature conditions that results in a single coloror an array of colors unique to that material under the temperaturesettings and reagents applied.

FIG. 2 shows an exemplary portable chemical detection device 10. Thedevice 10 has a housing 20 that supports a display 22 and input devicessuch as an on-off button 24 and navigation/selection buttons 26. In oneembodiment, the system has six buttons. The first button is the On/Offbutton. This button allows user to turn the unit on or off. Theremaining five buttons (Left, Right, Down, Up, and Enter) allows user tointeract with a Graphical User Interface (GUI) of the system. The GUI isflexible, efficient and user friendly.

The device 10 also has an input/output port 28 such as a USB port orFirewire port to communicate with a remote computer, and AC power port,among others. In one embodiment, the I/O port 28 is a weather proof PCinterface. The PC interface can set up operation parameters and recoveranalyzed data. In another embodiment, the I/O port 28 can include aflash memory card interface.

The device 10 also includes two ports 30 and 40 to receive userreplaceable test swipe media and chemical(s), respectively. The device10 also includes a port 41A to receive a user replaceable DC batterycartridge. Port 30 receives a test swipe 32. The port 40 receives achemical cartridge, which can house one or more chemical containers. Anelectronic controller 58 (shown in FIGS. 3A AND 3B) receives inputs fromthe buttons or keys and controls the display 22 and other electronics inthe device 10. The system can work with different power sourcesincluding battery port 41A and/or a DC input port 41B such as a car jackor an AC/DC adaptor.

The system of FIG. 2 is preferably a hand-held unit, which can mostpreferably be operated easily in real time by one operator. Moreover,the operation of such detectors should preferably be simple so thatnon-technical persons can operate the instrument properly, efficiently,and easily.

FIGS. 3A and 3B are two perspective top views that show in more detailsmajor components of the device 10. In the embodiment of FIG. 3A, aplurality of chemical containers or reservoirs 42 are mounted in adisposable cartridge 44 that is inserted into the unit 10. Thereservoirs 42 are punctured via safety needles with a side port and thechemicals are automatically or manually pumped from the reservoirs 42 byone or more micro-pumps 46. The chemicals are delivered through one ormore short length and small diameter delivery tubes connected to theoutputs of the micro-pumps 46 to the test swipe 32 during testing.

To test a contaminate collection swipe, a user opens the port 30 andplaces a test swipe 32 into a swipe holder 34. The swipe holder 34 movesalong sliding rails 36 when the user closes the port 30 to place thetest swipe 32 under a test chamber 38. The test chamber 38 includes achamber with two openings 52 that face a variable speed fan 54 to drawair across the test swipe 32 while under test. The test chamber alsoincludes a heating element 56 connected to a PID loop that can warm upthe test swipe 32 to multiple predetermined temperature settings duringtest. The test chamber also contains a camera 39 (FIGS. 3A AND 3B)

FIG. 4 shows in more detail port 30 that receives the test swipe 32 ofFIG. 3A in the swipe holder 34. The swipe holder 34 includes a door 60by which a user can press against to open or close the port 30. Theswipe holder 34 also includes an open face press-fit clamp 62 thatsecures the swipe 32 against a heating element 64 under the swipe 32upon closure. The swipe holder 34 is attached to rails 66 that slidewithin rails 68 to enable the swipe holder 34 carrying the test swab 32to move in and out of the device 10. An enclosure for the swipe holder34 is formed by positioning a lid 70 with an opening 72 between thesliding rails 68. The opening 72 allows movable tubes from themicro-pumps 46 to dispense test chemicals onto the swipe 32. The opening72 also allows a camera 39 (FIG. 5A) to capture images of the testresults for automatic real-time analysis of the test. A white-lightsource such as an LED is positioned near the camera that can be turnedon to provide lighting if needed and turned off when not used toconserve power. In one embodiment, the camera output is shown on thedisplay 22 (FIG. 2) so that the user or operator can visually determinethe test result(s) while the automated determination is in progress. Theopening 72 also allows a variable speed fan 54 to gently move vapor awayfrom the camera lens to avoid fogging the lens (anti-fogging).

The disposable chemical supply to be inserted into port 40 (FIG. 2)contains one or more reservoirs, each having an inlet that can bepunctured and is re-sealable so that the chemical in each reservoir canbe accessed by a tip or safety needle. The disposable cartridge also hasa key cooperating with a recess to ensure that the cartridge can only beinserted in a predetermined orientation. A micro-pump 46 (FIG. 3A)assembly receives the cartridge. Needles are provided to puncture thecartridge and to provide chemicals through short length, narrow gaugetubes (not shown) to their respective inputs at the micro-pumps. Eachmicro-pump has an inlet that is connected to the needles that may or maynot include safety tips and that are inserted into each reservoir whenthe user inserts the cartridge into the device. Another set of tubes areconnected to the outputs of the micro-pumps 46 to deliver the chemicalsin precise volume, sequence and timing as controlled by the processingelectronic controller 58.

FIGS. 5A and 5B show an exemplary perspective view of a camera 39 inconjunction with the test chamber 38. The chamber 38 includes a motor 92driving a gear 94. The gear 94 cooperates with a moveable arm 96 thatmoves test tubing fixture 98 back and forth over the test swab 32 duringtesting. The test tubing fixture 96 moves very closely to the swipe 32for chemical deposit onto the swipe when the device 10 is held in anyorientation. The arm 96 includes a plurality of openings that receive aplurality of tubes from the output of the micropumps 46. The arm 96 alsomoves the fixture 98 out of the way for the camera 39 to capture changeson the test swipe 32 during testing. The camera images are thenanalyzed, and the result can then be displayed on the display 22. In oneembodiment, the camera 39 can capture raw images with 65,536 colors. Thecamera is protected with an anti-fog feature using the adjustable speedfan 54. The image data can be shown continuously throughout the entireprocess on a flip-up display 22 with high fidelity. In one embodiment,the system provides a software JPEG encoder and decoder for storing andviewing previous results and images. The system also includes whitelight LEDs (not shown) located within the test chamber 38 that provideseven, shadow free, and uniform lighting during camera 39's operationwith a programmable white light intensity. The LEDs minimize shadows inthe camera viewing area.

The swipe holder 34 moves along rugged sliding rails 66 when the usercloses the port 30 to place the test swipe 32 under the test chamber 38.The test chamber 38 includes a chamber with two openings 52 that facethe fan 54 to draw air across the test swipe 32 while under test. Thetest chamber also includes a heating element 64 that can warm up thetest swipe 32 to a predetermined temperature during test.

FIG. 6 shows an exemplary block diagram of processing electronics forthe system of FIG. 1. A processor 200 controls all tasks done by thesystem. The processor 200 communicates over a bus 202 to variousdevices, including buttons interface 204, fan driver 206, speaker driver208, display controller 210, micro-pump driver 212, and USB controller214. The processor 200 also communicates with embedded memory 220 and aprogrammable ROM 224 that contains boot code as well as applicationcode. The processor 200 also drives buffers 226, 228 and 230 whichcontrols the LED, infrared sensor that informs the operator if a swipehas been loaded into the test chamber 38, and heat filament,respectively. The infrared sensor is positioned under the swipe and actsas a proximity sensor to detect the presence or absence of a swipe bythe amount of light reflected back. The processor 200 or controlleractuates the motor to drive a solution delivery manifold to the centerof the swipe and in close proximity to the swipe to dispense thesolution without dripping, regardless of orientation. The controller canmonitor fluid levels within each reservoir contained in the disposablecartridge. This is done by decrementing available volume each time thepump is actuated and when the count reaches a low threshold, thecontroller can indicate that the reservoir is out of chemical.

The system is powered by a 12-volt DC source, which can be generatedfrom an AC/DC converter, a car outlet or from eight 1.5-volt batteriesin series. The highest prioritized energy source is from an AC/DCconverter followed by the one from a car outlet, then the energy frombatteries. The 12-volt DC power source will supply current to the heaterand the pump. It is also connected to the low drop voltage regulator togenerate different voltage levels such as 5 V, 2.8 V and 3.3 V, whichare necessary for the processor and for other peripherals as well.

In one embodiment as a Portable Explosive Trace Detector (PETD), thesystem of FIG. 6 significantly enhances the detection of the explosivematerials as well as speeding up the screening and detecting proceduresat security checkpoints. First, the PETD automatically pumps a series ofchemical solution agents into the swiped sample and heats up to aspecific temperature to accelerate the chemical reactions. Second, aninternal CMOS camera captures the chemical reaction images at itshighest resolution, raw data for better image analysis. Third it thensends these raw images of data to the LCD (Liquid Crystal Display)screen for the purpose of observation. Moreover, the JPEG codec will bedeveloped for storing and replaying image functions. The LCD screenprovides a high quality image for human viewing. The LCD can analyze theimage to identify explosive materials based on the provided chemicalreaction database. Last but not least, the PC interfaces can be used toupdate software and firmware as well as to backup the data.

In one implementation, to start the analysis process, the systeminstructs the micro-pump(s) N (i.e., N=1, 2, 3 . . . or a combinationthereof) to disperse the chemical solution into the Swiped Sample. Thepumping rate is set to 2 Hz. After dispersing chemical solution, thesystem starts heating the sample to excite the chemical reactions undercontrolled vapor, time, temperature, and chemical volume conditionsspecific to a particular analyte or group of analytes. A current ofabout one ampere is applied to heat up the heating filament. During theheating process, the fluctuation of the temperature is controlled by afeedback circuit with a thermistor.

When the temperature of the sample swipe reaches a predefined value, thesystem turns the heater off, the white light LED on and the fan on. Thespeed of the fan is adjustable using pulse width modulation control inone embodiment.

Before commanding the camera's CMOS image sensor to capture an image,the system waits for the chemical reaction to complete for around 1 ms.The captured image is then displayed on the LCD.

The system creates a result image by subtracting the captured image fromthe background one. Then the result image is compared with the colorpatterns in the lookup table stored in the system. If the results imagematches some color pattern, the result probability will be displayed andan optional audible alarm is given or not. Otherwise, an appropriatemessage is displayed on the LCD.

During the process of writing to the memory, (e.g., saving results orupdating database), the system is able to detect the memory capacity andgive the user a warning of full memory. In such a case, the user needsto clear the memory by deleting certain files before commanding thesystem to continue its work.

In one embodiment, the system executes a prime pump procedure to clearup air and chemical bubbles in the tubes of minimized length anddiameter once the system has been idled for more than 12 hours. If thesystem has not been used for the past 12 hours then the system promptsthe user to place an empty swipe sample into a clamp holder. Once aswipe sample is secured on the clamp holder, the system prompts user todo the prime pump procedure by pumping chemical solutions onto swipesample. During the prime pumps, the camera captures the image from theswipe and displays it on the LCD screen. During the prime pumps, no heatis applied to the swipe.

In one embodiment, in the main menu, user can see the date, the time andcurrent status of the system. The system can generate a warning alarmonce battery, chemical level and memory reach their minimal levels. Themenu also contains three (3) software programmable buttons, namely NewAnalysis, Previous Results, and Settings. User can interact with thesesoft buttons by using the five hard buttons. The New Analysis option ishighlighted as default. The usage of these soft buttons is as follows:

New Analysis: allows user to perform a new test.

Previous Results: allows user to trace back the data tested in the past.

Settings: allows user to set parameters such as date, time, to test thesystem reliability, or to connect to PC for firmware and/or databaseupdate.

The user can see the images taken by the camera. The system status isalso displayed. In addition, three (3) soft buttons (Start, Stop, andStatus) are provided. The Start option is highlighted as default.

FIG. 7 shows an exemplary operational flow chart executed by the systemof FIG. 1. When the system is turned on by pressing the Start Power Onbutton, it will stay in IDLE state 304. In this state, the system waitsfor user commands. By default, both the camera lighting LED and the fanare turned off. The system sends an appropriate message alarm to theoperator once chemical, battery, and memory reach their minimal level.User may command the system to perform a new test by selecting NewAnalysis, to view previous results and images by selecting PreviousResults, or to update the firmware and/or database.

When the option of performing a New Analysis is selected, the systemchecks whether the Slide Door Switch is closed or not (360). If the dooris not closed, it will display a warning message (400) and return toIDLE state 304. Otherwise, it looks for a loaded Swiped Sample using theinfrared sensor (362). The presence of the sample allows the system tomove to the next state, where it checks for the fluid levels of thethree reservoirs to ensure that the fluids are enough for the entiretest process (364). The amount of fluid is determined by the number ofdispenses (i.e., a full bottle is enough for a predetermined number ofdispenses and the number is decremented during each of the dispenses).

Before continuing, the system checks the temperature of the filament ifit is equal to 35° C. in one embodiment. Otherwise, it will have to heatthe filament until the temperature of the filament reaches 35° C. (374)(FIG. 7D). At this temperature, the user is allowed to choose differentoptions. If the user presses the Stop button (368), the system will stopthe work and return to the IDLE state. If the user chooses the Statusbutton (370), the system will temporarily display its current task toturn the system status on/off. After that it returns and continues theprevious work. When the user presses Start button (372), the systemturns the Fan on to blow the fog or vapor away from the camera, turnsthe LEDs on, turns the fan 39 to a low speed and takes a backgroundimage using the camera (378). Then, the system will select a particularmicro-pump N=1 or a series of micro-pumps (N=1, 2. 3 . . . or acombination thereof) and start analyzing the sample based on the imageanalysis process (380-386). Once the New Analysis operation is inprocess, it takes a number of different tests (in one embodiment seventests) non-stop and summarizes the test results after the last test hascompleted. The image results are saved automatically as a group by atime date stamp and can be further sorted by positive or negativeresults for ease by viewing recall (392-394). Different audible soundscan be played at the end of each test to catch the operators attention.The image result is obtained by subtracting the current image from itsinitial background image. After finishing this analysis, the system asksuser if he/she wants to review the test summary or else return to themain menu.

When the option of viewing previous results is selected, the user canselect his/her desired filename and presses Display button to commandthe system to decompress and display the image and/or other necessaryinformation (402-408).

When the option of updating date, time, database and/or firmware isselected (306), the system shows a menu to allow the user to choosedifferent options such as update date, time, or upgrade the firmware, ortest the reliability of the system. For example, when the user pressesthe date button (308), the system allows the user to change the date viathe buttons of the system. After the date is confirmed to be changed,the system will store the change in its memory and return to theprevious menu to allow the user to choose other options. The changes ofthe time (310) functions in the same manner as the change of the date.

In case the user wants to update the database by pressing Databasebutton (316), the system communicates with the PC in order to set up achannel for data transfer (312). Upon a successful connection the usercan update database and/or firmware. After the firmware or database isupdated, the user presses the Ok button to return to the main menu. Whenthe system connects to the PC unsuccessfully, it warns the user to checkthe connection (316).

When the user wants to test the reliability of the system, the user canpress the Test button (322). As soon as this button is pressed, the usercan test different system parameters. He/she can save the changedparameter or restore default parameter. When the user presses Exitbutton, system returns to the main menu.

By having all components under program control and by arranging for aknown input to the system such as a controlled injection of targetmaterial, the system can perform self-calibration and self-diagnostic.The function of this program is to calibrate the entire system anddetermine and store the required time, and temperature parameter, amongothers. If these parameters are not within specified limits for anyreason, the program can alert the user. Guided by a service program theuser response can range from immediate shutdown to scheduling service ata later date, to simply noting the circumstances.

FIG. 8 shows an exemplary image analysis process executed by theprocessor 200 to detect chemical agents automatically. To start theanalysis process, the system turns the micro-pump(s) N (i.e., N=1, 2, 3. . . or a combination thereof) to disperse the chemical solution intothe Swiped Sample. The pumping rate is set to 2 Hz. After dispersingchemical solution, the system starts heating the sample to excite thechemical reactions. A current of about 1 Ampere is required to heat upthe filament. When the temperature of the sample reaches a predefinedvalue, the system turns the heater off, the LED and the fan on. In oneembodiment, before commanding the CMOS image sensor to capture an image,the system waits for the chemical reaction under optimized: time,temperature, volume dispensed, and vapor to complete for around 1 ms.The captured image is then displayed on the LCD. The system creates aresult image by subtracting the captured image from the background one.Then the result image is compared with the color patterns in the lookuptable stored in the memory. If the results image matches some pattern,the result will be displayed and an audible alarm is given. Otherwise,an appropriate message is displayed on the LCD.

Due to the automated analysis, the system provides an objectiveindication of potential threats with more accurate results and moreconvenience.

The invention may be implemented in hardware, firmware or software, or acombination of the three. Preferably the invention is implemented in acomputer program executed on a programmable computer having a processor,a data storage system, volatile and non-volatile memory and/or storageelements, at least one input device and at least one output device.

By way of example, a block diagram of a computer to support the systemis discussed next. The computer preferably includes a processor, randomaccess memory (RAM), a program memory (preferably a writable read-onlymemory (ROM) such as a flash ROM) and an input/output (I/O) controllercoupled by a CPU bus. The computer may optionally include a hard drivecontroller which is coupled to a hard disk and CPU bus. Hard disk may beused for storing application programs, such as the present invention,and data. Alternatively, application programs may be stored in RAM orROM. I/O controller is coupled by means of an I/O bus to an I/Ointerface. I/O interface receives and transmits data in analog ordigital form over communication links such as a serial link, local areanetwork, wireless link, and parallel link. Optionally, a display, akeyboard and a pointing device (mouse) may also be connected to I/O bus.Alternatively, separate connections (separate buses) may be used for I/Ointerface, display, keyboard and pointing device. Programmableprocessing system may be preprogrammed or it may be programmed (andreprogrammed) by downloading a program from another source (e.g., afloppy disk, CD-ROM, or another computer).

Each computer program is tangibly stored in a machine-readable,removable storage media or device (e.g., program memory or magneticdisk) readable by a general or special purpose programmable computer,for configuring and controlling operation of a computer when the storagemedia or device is read by the computer to perform the proceduresdescribed herein. The inventive system may also be considered to beembodied in a computer-readable storage medium, configured with acomputer program, where the storage medium so configured causes acomputer to operate in a specific and predefined manner to perform thefunctions described herein.

The invention has been described herein in considerable detail in orderto comply with the patent Statutes and to provide those skilled in theart with the information needed to apply the novel principles and toconstruct and use such specialized components as are required. However,it is to be understood that the invention can be carried out byspecifically different equipment and devices, and that variousmodifications, both as to the equipment details and operatingprocedures, can be accomplished without departing from the scope of theinvention itself.

Although specific embodiments of the present invention have beenillustrated in the accompanying drawings and described in the foregoingdetailed description, it will be understood that the invention is notlimited to the particular embodiments described herein, but is capableof numerous rearrangements, modifications, and substitutions withoutdeparting from the scope of the invention. The following claims areintended to encompass all such modifications.

1. A method to detect the presence of a substance on a test swipe,comprising: capturing a background image of the test swipe; applying oneor more test chemicals to a test swipe; adjusting the temperature of thetest swipe to a predetermined temperature range; capturing an in-situimage of the test swipe after the application of chemical at thepredetermined temperature range; subtracting the background image fromthe in-situ image; generating a difference value from the two images;and searching a known database to identify the substance.
 2. The methodof claim 1, comprising removing chemical vapor rising above apredetermined distance above the test swipe to avoid fogging thecamera's lens.
 3. The method of claim 1, comprising fanning chemicalvapor rising above a predetermined distance above the test swipe toavoid fogging the camera's lens.
 4. The method of claim 1, comprisingallowing chemical vapor to remain within a predetermined distance abovethe test swipe.
 5. The method of claim 1, comprising placing a solidstate light source near the camera to provide lighting.
 6. The method ofclaim 1, wherein the solid state light source comprises an LED.
 7. Themethod of claim 1, wherein the chemicals are applied in parallel ondifferent parts of the test swipe.
 8. The method of claim 1, wherein theone or more chemicals are applied in sequence, each swipe elevated to apredetermined temperature for each chemical.
 9. The method of claim 1,wherein the chemicals are applied at one time.
 10. The method of claim1, wherein the chemicals are applied in sequence.
 11. The method ofclaim 1, comprising generating a database of known substances byapplying one or more chemicals to one or more control swipes.
 12. Themethod of claim 11, comprising generating a signature of each substanceby subtracting a background image against an image of each control swipewith one or more chemicals applied thereto, wherein the one or morechemicals applied to the test swipe and the control swipe are identical.13. The method of claim 11, comprising exposing the control swipe andthe test swipe to the same predetermined temperature sequence.
 14. Themethod of claim 11, comprising dispensing one or more chemicals onto thetest swipe and the control swipe through one or more pumps throughoutthe temperature sequence.
 15. The method of claim 1, comprising removingchemical vapors rising a predetermined distance from the test swipe butleaving vapors immediately in contact with the swipe.
 16. The method ofclaim 1, comprising heating the test swipe to one or more predeterminedtemperatures and hold times using an automatic ramped heating feedbackcontrol.
 17. The method of claim 1, comprising performing image analysisin real-time.
 18. The method of claim 1, comprising protecting a camerawith anti-fog protection.
 19. The method of claim 1, comprisingdisplaying the in-situ image in real-time for user review whileanalyzing the image to detect the substance.
 20. The method of claim 15,comprising performing automatic calibration under different lightingenvironments.
 21. An apparatus to analyze a test swipe to identify achemical composition, comprising: a heater to warm the test swipe tovarious predetermined temperatures at various hold times; a clamp tosecure the test swipe to the heater; one or more pumps to dispense oneor more chemicals onto the test swipe from a disposable cartridge; a fanto remove chemical vapors rising a predetermined distance from the testswipe but leaving vapors immediately in contact with the swipe; a camerato capture an image of the test swipe for analysis and for real-timeviewing by the operator to provide secondary level of assessment; and aprocessor and computer readable code coupled to the camera, the computerreadable code includes capturing a background image of the test swipe;applying one or more test chemicals to a test swipe; adjusting thetemperature of the test swipe to a predetermined temperature range;capturing an in-situ image of the test swipe after the application ofchemical at the predetermined temperature range; subtracting thebackground image from the in-situ image; generating a difference valuefrom the two images; and searching a known database to identify thesubstance.